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AN  EQUIVALENCE  BETWEEN  TWO  ALGORITHMS 
FOR  QUADRATIC  PROGRAMMING 

Jong -Shi  Pang 


ABSTRACT;  In  this  paper,  we  demonstrate  that  the  Van  de  Panne -Whins ton 
syranetric  simplex  method  when  applied  to  a  certain  implicit  formulation 
of  a  quadratic  program  generates  the  same  sequence  of  primal  feasible 
vectors  as  does  the  Von  Hohenbalken  simplicial  decomposition  algorithm 
specialized  to  the  same  program.  Such  an  equivalence  of  the  two 
algorithms  extends  earlier  results  for  a  least -distance  program  due  to 
Cottle-Djang. 
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1 .  INTRODUCTION.  There  has  been  an  excessive  number  of  algorithms 
for  solving  a  convex  quadratic  program  which  are  based  on  the  Kuhn-Tucker 
optimality  formulation  of  the  program  and  employ  simplex  pivots.  An 
undesirable  feature  of  such  a  pivoting  algorithm  is  that  typically,  the 
Kuhn-Tucker  formulation  contains  more  variables  (multipliers  of  the 
constraints)  than  the  program  itself. 

In  two  recent  papers  (Refs.  1  and  2),  Von  Hohenbalken  has  described 
a  simplicial  decomposition  algorithm  for  solving  a  nonlinear  minimization 
program  with  a  pseudoconvex  objective  function  and  with  a  convex  compact 
feasible  set.  The  algorithm  requires  no  dual  variables  and  therefore 
eliminates  the  undesirable  feature  of  having  to  operate  on  a  formulation 
with  extra  variables.  Another  advantage  of  the  algorithm  when  applied  to 
linearly  constrainted  problems  (such  as  quadratic  programs)  is  that  the 
powerful  simplex  method  of  linear  programming  can  be  employed  to  solve  the 
subprograms . 

This  paper  is  concerned  with  the  study  of  two  algorithms  for  convex 
quadratic  programing .  One  is  the  Von  Hohenbalken  algorithm  and  the  other 
is  the  symmetric  simplex  method  due  to  Van  de  Panne -Whins ton  (Ref.  3).  It 
is  shown  that  the  former  algorithm  specialized  to  a  convex  quadratic  program 
with  bounded  feasible  set  generates  the  same  sequence  of  primal  feasible 
vectors  as  does  the  latter  applied  to  a  certain  implicit  formulation  of  the 
given  program.  This  result  has  two  implications.  First,  the  specialized 
Von  Hohenbalken  algorithm  can  thus  be  viewed  as  a  pivoting  algorithm.  Second, 
the  Van  de  Panne -Whins  jn  algorithm  may  be  implemented  as  a  decomposition 
algorithm  requiring  no  extra  variables  (the  multipliers).  As  a  remark, 
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we  mention  that  Von  Hohenbalken ’ s  algorithm  has  been  applied  quite 
successfully  for  solving  some  fairly  large  quadratic  programs  arising 
from  portfolio  selection  (Ref.  4). 

It  is  important  to  point  out  that  Van  de  Panne -Whins ton  algorithm 
when  applied  to  the  standard  formulation  of  a  quadratic  program 

X  T  n 

minimize  c  x  +  £x  Cx  subject  to  x  €X  =  £x€R  :  x  >  0,  Ax  =•  b,  Dx  <  d]  (1) 

may  not  produce  the  same  sequence  of  primal  feasible  vectors  as  does 
Von  Hohenbalken  algorithm.  An  example  (due  to  A.  Djang)  given  in  the 
Appendix  will  illustrate  this  fact. 

Obviously,  by  using  the  representation  of  the  feasible  set  X  in 
terms  of  its  extreme  points  and  rays,  the  quadratic  program  (1)  is 
equivalent  to  the  one  below 

minimize  (FT)  +  Q5)Tc  +  £(p^  +  Q§)TC  (PT)  +  Q§)  (2) 

T 

subject  to  e  T)  *  1  ;  %  and  T\  >  0  . 

Here  P  and  Q  are  the  matrices  of  extreme  points  and  rays  of  the  set  X 
respectively;  and  e  is  the  vector  of  ones.  Due  to  the  fact  that  P  and  Q 
are  known  only  implicitly,  we  shall  call  (2)  the  implicit  formulation 
of  the  quadratic  program  (1).  It  is  our  contention  that  when  van  de  Panne- 
Whinston  algorithm  is  applied  to  (2)  with  a  vacuous  Q,  (l.e.,  with  the 
feasible  set  of  the  original  program  (1)  being  bounded)  it  produces  exactly 
the  same  sequence  of  primal  feasible  vectors  as  Von  Hohenbalken  algorithm 
is  applied  to  (1).  A  noteworthy  point  here  is  that  in  order  for  the 
former  algorithm  to  be  applicable  to  (2) ,  it  is  necessary  to  be  able  to 
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implement  the  algorithm  without  the  full  knowledge  of  the  matrices  of 
generators.  The  tool  employed  to  achieve  this  is  the  column  generation 
technique  described  in  (Ref.  5).  Incidentally  the  algorithm  described 
in  the  reference  provides  an  alternative  method  for  solving  the  quadratic 
program  (1)  without  the  use  of  multipliers.  In  the  case  where  the 
matrix  P  is  explicitly  given,  the  matrix  Q  is  vacuous,  the  matrix  C  is 
an  identity  and  the  vector  c  is  zero,  the  quadratic  program  (2)  reduces 
to  the  least -distance  program  studied  in  (Ref.  6)  where  the  equivalence  of 
the  Van  de  Panne -Whins ton  and  Von  Hohenbalken  algorithms  has  been 
established. 

The  idea  of  using  the  implicit  formulation  (2)  to  solve  the 
quadratic  program  (1)  has  previously  appeared  in  an  unpublished  paper 
by  Sacher  (Ref.  7)  who  proposed  a  decomposition  algorithm  that  involves 
solving  quadratic  subprograms  by  Lemke's  method.  As  we  shall  see  both 
Van  de  Panne -Whins ton  and  Von  Hohenbalken  algorithms  require  solving 
systems  of  linear  equations  and  linear  subprograms  only. 

The  rest  of  the  paper  is  organized  as  follows.  In  the  next  section, 
we  describe  a  revised  version  of  the  Van  de  Panne -Whins ton  algorithm 
applied  to  solve  a  quadratic  program  of  the  form 

T  T 

minimize  q  x  +  Jx  Gx  subject  to  x  >  0  and  Ax  =  b  .  (3) 

This  version  operates  directly  on  the  equality  constraints  without 
converting  them  into  inequalities.  In  Section  3,  we  apply  this  revised 
algorithm  to  (2)  and  describe  the  column  generation  technique  to  show  how 
the  algorithm  can  actually  be  implemented  without  the  explicit  knowledge 
of  the  matrices  P  and  Q.  In  Section  4,  we  establish  a  necessary  and 
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sufficient  condition  for  an  exchange  pivot  to  occur  in  the  application 
of  the  revised  Van  de  Panne -Whins ton  algorithm  to  solve  the  implicit 
formulation  (2)  of  the  quadratic  program.  A  consequence  of  this  result 
is  that  the  finite  termination  of  the  algorithm  can  be  established 
without  the  assumption  of  nondegeneracy.  Such  conclusions  extend  those 
established  by  Cottle  and  Djang  (Ref.  6)  for  the  least-distance  program. 
Finally,  in  the  fifth  and  last  section,  we  establish  the  above-mentioned 
equivalence  between  Van  de  Panne -Whins ton  and  Von  Hohenbalken  algorithms. 

2.  THE  SYMMETRIC  SIMPLEX  METHOD  OF  VAN  DE  PANNE  -  WHINSTON  .  We  first 
summarize  the  operations  of  the  Van  de  Panne -Whins ton  symmetric  simplex 
method  for  solving  a  general  convex  quadratic  program  (Ref.  3).  To  start, 
obtain  a  primal  feasible  vector  by  means  of  a  Phase  I  simplex  method.  With 
this  vector,  set  up  the  initial  standard  tableau  of  the  Kuhn-Tucker 
conditions  so  that  no  pair  of  corresponding  primal  and  dual  variables  is 
simultaneously  basic.  Choose  as  a  driving  variable  the  primal  nonbasic 
variable  whose  corresponding  dual  complement  is  most  negative.  If  no 
such  variable  can  be  identified,  stop;  the  current  primal  feasible  vector 
is  optimal.  Otherwise,  increase  the  driving  variable  until  it  is  blocked 
by  either  its  dual  complement  becoming  nonnegative  or  by  some  other  basic 
primal  variable  becoming  nonpositive.  If  there  is  no  blocking  variable, 
stop;  the  given  program  has  an  unbounded  objective  value.  If  the  blocking 
variable  is  the  dual  complement,  perform  a  principal  pivot  making  the 
driving  primal  variable  basic  and  the  corresponding  blocking  dual 
complement  nonbasic  (IN-PIVOT) .  This  completes  a  major  cycle  and  the 
algorithm  attempts  to  find  a  new  driving  variable.  If  the  blocking 
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variable  is  some  other  basic  primal  variable,  then  either  a  simple 
principal  pivot  or  a  double  pivot  is  performed,  depending  on  whether 
the  former  is  possible.  If  the  principal  pivot  is  in  fact  possible, 
then  a  minor  cycle  is  entered  with  the  current  driving  variable  unchanged 
(OUT-PIVOT).  Such  a  minor  cycle  must  terminate  in  a  finite  number  of 
iterations  with  the  driving  variable  becoming  basic  and  its  dual  complement 
nonbasic.  At  that  point,  a  new  major  cycle  starts.  Finally,  if  a  double 
pivot  is  performed,  then  the  current  major  cycle  is  completed  and  a  new  one 
begins  (EXCHANGE -PIVOT) . 

Referring  to  the  quadratic  program  (3) ,  we  say  that  an  index  set  a 
is  basic  feasible  if  (i)  the  associated  basis  matrix 


0 


where  G  is  the  principal  submatrix  of  G  indexed  by  a  and  A.  consists 
aa  a 

of  the  columns  of  A  indexed  by  a,  is  nonsingular;  and  (ii)  the  vector 


a 

* 


-  B(a) 


satisfies  x  >0. 

a  ■ 


* 

If  a  is  a  basic  feasible  index  set,  the  vectors  x  - 


“  1  and  X* 


satisfy  the  Kuhn-Tucker  conditions  of  the  program  (3) 
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u  ■  q  +  Gx  +  AT\  >0  ,  x  >  0 

■  m 

0  -  b  -  Ax  ,  uTx  -  0 


except  possibly  for  the  nonnegativity  of  the  vector  u*  ■  q  +  Gx*  +  ATX* 

•ft 

Note  that  u^  -  0.  The  standard  system  corresponding  to  the  (basic  feasible) 
index  set  a  is 


«s„<vT> B(0,>'' 

G«e  \ 

-s 

where  j)  is  the  complement  of  <*. 

In  what  follows,  we  state  a  revised  version  of  Van  de  Panne -Whins ton 
algorithm  applied  to  the  quadratic  program  (3).  This  version  operates  with 
basic  feasible  index  sets  and  keeps  track  of  the  useful  ingredients  only. 

In  particular,  it  does  not  require  the  full  knowledge  of  the  system  (4)  and 
can  thus  be  considered  as  an  analog  of  the  revised  simplex  method  of  linear 
programing. 

Let  or  be  a  given  basic  feasible  index  set.  Solve  the  system  of  linear 


7 


,  *  * 
equations  for  x  and  \ 

Of 


B(ar) 


a 

* 


-  <1 


or 

b 


and  compute 


"»+ <=»-*- +  (A./j* 


la  'io  T  li.  X 

9  9  Bar  or 


(5) 


(6) 


The  vector  gives  the  values  of  the  currently  basic  dual  variables. 
Determine  an  index  t  €  {3  so  that 


q  -  min  (q  )  .  (7) 

i  €p  L 


If  qt  *  st°P»  the  progr3®  (3)  is  solved.  Otherwise,  solve  the  system 
of  linear  equations  for  f  and  h 


B(cr)  /  f 


and  compute 


'tt 


Gtt  +  fa  + 


(8) 


Note  that  Gtt  gives  the  diagonal  entry  corresponding  to  the  pair  of  driving 

variable  and  its  complement  u  .  If  <5  =*  0  and  f  >0,  stop:  the 

t  r  t  tt  a  m 

program  (3)  is  unbounded  below.  Otherwise,  determine 


- 


8 


min  {  -  /  f ^ 


f j  <  0,  j  €  a  } 


(9) 


if 


>  0 


if  G 


tt 


0 


2  1 

If  9  <  9  ,  add  the  index  t  to  the  set  or  and  return  to  solve  a  new  system 

2  1 

of  linear  equations  (5).  This  corresponds  to  an  IN-PIVOT.  If  9  >  9  , 

let  s  be  a  minimizing  index  in  (9).  Solve  the  system  of  linear  equations 

for  f  and  h 
a 


B(ar)  /f 


or 

h 


(10) 


s 

where  e^  is  a  unit  vector  with  a  one  in  component  s.  If  f  >  0,  drop  the 

index  s  from  the  set  a  and  return  to  solve  a  new  system  (5).  Skip  the 

comparison  (7)  and  proceed  directly  to  (8)  after  the  solution  of  (5)  with 

the  same  index  t.  This  corresponds  to  an  OUT-PIVOT.  Finally,  if  f  =  0, 

replace  OfbyarXfsJuCO  and  return  to  (5) .  This  corresponds  to  an 

EXCHANGE -PIVOT.  Note  that  f^  is  the  diagonal  entry  corresponding  to  the 

pair  of  blocking  variable  x  and  its  complement  u 

s  s 

In  practice,  the  system  of  linear  equations  (5,  8,  10)  should  best  be 
solved  adaptively  by  a  factorization  scheme  which  takes  advantage  of  the 
change  of  the  basis  matrix  B(a)  (such  as  those  described  in  (Ref.  8)). 

We  close  this  section  by  repeating  an  important  fact.  Namely, 
throughout  the  algorithm,  each  index  set  or  is  basic  feasible. 
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3.  THE  IMPLICIT  FORMULATION  AND  THE  COLUMN  GENERATION  TECHNIQUE.  In  this 
section,  we  specialize  the  revised  Van  de  Panne -Whins ton  algorithm  to  the 
implicit  formulation  (2)  of  the  quadratic  program  (1).  In  this  specialization, 
each  basic  feasible  index  set  a  is  the  disjoint  union  of  two  index  sets 
3^  and  (*2  consisting  of  the  indices  of  the  basic  T]-  and  ^-variables 
respectively.  The  associated  basis  matrix  is  then 


B(or  ,  a  )  =  /  (P  )T  CP  (P  )T  CQ  e 

1  2  /  “l  “1  ®1  “2  *1 


(Q  )T  CP  (Q  )T  CQ  0 

®2  ®1  ®2  ®2 


Throughout  the  algorithm,  a^  is  always  nonempty  whereas  a^  may  be  empty. 

Initially,  is  a  singleton  and  empty.  Each  index  in  a^ (a^)  corresponds 

to  an  extreme  point  (ray)  of  the  feasible  set  X.  The  corresponding 

feasible  vector  is  given  by  x  =  P  T1  +Q  5  where  P  (Q  )  consists  of 

“l  ®2  ®2  ®1  ®2 

the  columns  of  the  matrix  P(Q)  indexed  by  (a2  respectively).  These 

columns  P  and  Q  are  to  be  stored  after  they  are  generated.  As  pointed 
*1  ®2 

out  in  (Ref.  5),  there  is  a  reasonable  limit  on  the  number  of  such  columns 

required  in  each  iteration  of  the  algorithm. 

With  the  index  sets  a,  and  a„  and  columns  P  and  Q  given,  the 

12  a1  ®2 


system  (5)  may  be  written  as 


p  1 


The  scalar  p  is  the  multiplier  of  the  convexity  constraint  in  (2) .  After 
the  solution  of  the  system  of  linear  equations  (11),  one  needs  to  determine 
the  index  t.  From  (6),  we  have 


By  (11),  it  follows  that 


-  0  . 


Therefore  q  >  0  if  and  only  if 
P  “ 

xT(c  +  Cx  )  +  p  >0  for  all  x  €X  . 

Hence  to  determine  the  desired  index  t,  one  may  solve  the  linear  program 

minimize  L(x  )  »  x  (c  +  Cx  )  subject  to  x€X  .  (13) 

-  ic 

Either  this  program  has  a  finite  optimum  L(x  )  or  it  is  unbounded  below. 

In  the  second  case,  an  extreme  ray  with  t  is  obtained.  In  the 
-  *  * 

first  case,  if  L(x  )  +  p  >  0,  then  the  program  (2)  (and  thus  (1))  is 

solved.  Otherwise  an  extreme  vector  P£  with  tfa^  is  obtained.  In 

either  case,  if  the  program  (2)  is  not  solved  yet,  an  index  t  and  a 

corresponding  vector  P  or  Q  are  obtained  such  that  q  *  min  fq  )  is 

t  t  C  i€g  1 

^  »,  lit  “fc  _  "fc 

negative.  Note  that  q^  a  L(x  )  +  p  where  L(x  )  denotes  the  final 
objective  value  of  the  linear  program  (13).  With  the  index  t  determined, 
the  rest  of  the  major  cycle  can  be  completed  without  difficulty. 

To  summarize,  we  present  below  a  detailed  description  of  the  revised 
Van  de  Panne -Whins ton  algorithm  specialized  to  the  implicit  formulation 
(2)  of  the  quadratic  program  (1). 

Step  0  (Initialization)  Solve  the  linear  program 

T 

minimize  c  x  subject  to  x€X  . 

If  this  program  is  infeasible,  stop;  so  is  the  quadratic  program  (1). 
Otherwise  let  P^  be  an  extreme  point  feasible  vector.  Set  «  £  1  j 
and  a  0  .  (See  Remark  1.) 
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Step  1  (Major  Cycle)  Solve  the  system  of  linear  equations  (11)  for 

*  *  *  * 

»  =/*  and  P  •  Define  the  vector  x  by  (12)  and  solve  the  linear 
1  2 

program  (13).  (See  Remark  2.) 

Step  2  (Termination  Test)  Does  the  final  objective  value  L(x  )  of  the 

linear  program  (13)  satisfy  L(x  )  +  p  >0?  If  yes,  stop;  the  current 
* 

x  is  a  desired  optimum  solution  to  the  quadratic  program  (1).  Otherwise, 
continue. 

Step  3  (Minor  Cycle)  Let  P  (or  Q^)  be  the  extreme  point  (ray)  solution 

obtained  at  the  termination  of  the  linear  program  (13).  Solve  the  system  of 

linear  equations  for  f  ,  g  and  h: 

*1  a2 


B(V  V  /f«. 


<p«,)Tcpt\  or  -  /<p«,)TcQt 


(Q„  )  CPt 
*2  C 


(Q„  )  CQ 
a2  C 


-1  / 


and  compute  the  diagonal  entry 


-  (PJT  CP  +  (P  )T  C(P  f  +  Q  g  )  +  h 
tt  t  t  t  ®i  a2  ®2 


05a) 


G  -  (Q.)T  CQ  +  (Q  )T  C(Pa  f  +  Qa  R  )  +  h 
tt  t  t  t  ®i  ®2  ®2 


(15b) 
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Step  4  (Teat  for  Unboundedness)  If  Gtt  ■ 
quadratic  program  (1)  is  unbounded  below. 


0  and  |  “l  |  >  0  ,  stop; 


Otherwise  continue. 


the 


Step  5  (Ratio  Test)  Determine  the  minimum  ratios 
ej  =  min  £  -  1\*  /  :  f£  <  0  ,  i 


9 


1  ^ 

2  -  min  {  -  /  gi  ;  gi  <  0  ,  i  €a2] 


and  let 


91  -  min  {ej  ,  9^  )  , 

92  =  r -  (L (x*)  +  p*)  /  G 


tt 


if  Gtt  >  0 


otherwise 


Ste£_6  (In-Pivot)  If  02  <  01  ,  replace  a,  (or  aj  by  ^  U  {  t  }  (<*2  U  {  t  }  ) 
depending  on  whether  Pt  or  Qt  is  obtained  at  Step  3.  Go  to  Step  1.  If 
2  1 

9  >  9  ,  continue. 

SteP  7  (Check  Pivot)  Let  s  be  a  minimizing  index  in  9^.  Solve  the  system  of 
linear  equations  for  f  ,  g  and  h: 

ai  ®_ 


14 


depending  on  whether  s  €a.  or  s  €a  .  Here  e8  and  e8  are  unit  vectors 

12  *1  *2 
with  a  one  in  component  s. 

Step  8  (Exchange  Pivot)  If  s€at  (a  )  and  f  (g  )  -  0,  replace  a, (a0) 

i  4  s  s  12 

by  (*2)  \  {  s  )  U  {  t  }  and  go  to  Step  1.  Otherwise  continue. 

Step  9  (Out -Pivot)  Replace  ar^ora^  by  «1(a2)  \  {  s  } .  Solve  the  system 
of  linear  equations  (11).  Retain  the  same  vector  P  or  Qt  and  go  to  Step  3. 

Remarks  1.  This  is  just  one  way  of  getting  an  initial  extreme  point 
feasible  vector. 

2.  If  a^  is  a  singleton  and  a2  is  empty  (as  in  the  initialization 
step),  then  the  unique  solution  to  the  system  (11)  is  trivial  to  obtain. 

*  ie 

In  particular,  T]  must  be  equal  to  1  and  thus  x  =  p  .  A  similar 
“l  «1 

remark  holds  for  the  systems  in  steps  3  and  7. 

By  using  (14),  it  is  easy  to  see  that  the  expressions  (15a)  and 

(15b)  can  be  simplified  as: 


Kt  -  (Pt  +  Pa  f  +  <L  gw  )  C  (P  +  P  f  +  Q  g  ) 
ft  t  «a  a,  «2  ®2  t  a,  a,  a2  a2 


G  -  (Q  +  P  f  +  Q  )  C  (Q  +  P  f  +  Q  g  )  • 
“  C  *1  *1  *2  ®2  C  “l  “l  *2  a2 


(16a) 

(16b) 


We  close  this  section  by  pointing  out  two  more  remarks.  First,  if 
the  feasible  set  X  is  bounded,  then  Step  4  of  the  algorithm  will  never  happen. 
It  can  therefore  be  skipped.  Second,  if  the  program  (1)  is  strictly  convex  or 
equivalently,  if  the  matrix  C  is  positive  definite,  then  by  (16)  and  the 
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definition  of  the  index  t,  it  can  be  easily  shown  that  the  entry  G 
is  always  positive.  Two  consequences  of  this  result  are:  (i)  again. 
Step  4  will  never  happen;  and  (ii)  the  algorithm  will  always  compute 
an  optimum  solution  of  the  program  (1). 


4.  THE  EXCHANGE  PIVOTS.  In  (Ref.  6)  it  is  shown  that  for  the  least- 

distance  program,  the  exchange  pivot  (Step  8)  is  never  performed  because 

the  pivot  entry  (f  )  is  always  positive.  A  consequence  of  this  result  is 
s 

that  the  finite  termination  of  the  algorithm  can  be  established  without 
the  assumption  of  nondegeneracy,  i.e.,  the  assumption  that  the  basic 
primal  variables  are  positive  in  each  tableau.  In  this  section,  we  extend 
these  results. 

Theorem  3,1.  Consider  the  application  of  the  revised  Van  de  Paime- 
Whinston  algorithm  to  the  implicit  formulation  (2)  of  the  convex  quadratic 
program  (1)  as  discussed  in  Section  3.  Then  an  exchange  pivot  is  performed 
if  and  only  if  an  in-pivot  is  not  performed  and  the  current  index  set  cr^ 
is  the  singleton  {s  }  . 

To  prove  this  lenma,  we  first  establish 
Lemma  3,2.  Let  C  be  symmetric  positive  semi -definite.  If  B(cr^ ,  a^)  is 
nonsingular,  then  so  is  each  B(o^ ,  for  any  er'  c  er^  ,  ar'2  c 
and  or'  f  0  . 

Proof.  Suppose  that  for  some  such  subsets  a'  and  »  B(er'  ,  a^)  is 
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(i)  s  €a0  implies  g  >  0  ;  and 

z  s 

(ii)  s  6a,  implies  f  >0  unless  the  current  index  set  a.  is  the 

1  S  I 

singleton  { s  }. 

In  fact,  both  of  these  assertions  follow  easily  from  the  previous 
lemma.  Q.E.D. 

Theorem  3.1  implies  that  it  is  not  necessary  to  execute  Step  7  in 
the  algorithm  to  determine  if  an  exchange  pivot  is  performed.  In  words 
an  exchange  pivot  corresponds  to  an  exchange  of  the  extreme  point  Ps 
with  another  one  Pt<  The  reason  that  such  a  pivot  is  never  performed 
in  the  least-distance  program  is  due  to  the  choice  of  the  initial  extreme 
vector  as  one  minimizing  the  given  objective  function.  Such  a  choice  is 
clearly  impossible  in  the  present  situation  because  one  does  not  know 
all  the  extreme  points  in  advance.  An  exchange  pivot  can  thus  be  thought 
of  as  a  search  for  such  an  extreme  point. 

Corollary  3.3.  No  nondegeneracy  assumption  is  needed  for  the  finite 
termination  of  the  algorithm. 


Proof.  In  fact,  as  pointed  out  in  (Ref.  6),  a  degenerate  (i.e.,  zero)  basic 

primal  variable  in  any  tableau  may  be  dropped  from  the  basis  by  an 

out -pivot.  So  if  a  tableau  contains  such  variables,  after  several  such 

out -pivots,  either  of  two  cases  will  arise:  (i)  the  cardinality  of 

a^  is  1 ,  or  (ii)  the  cardinality  of  a^  is  greater  than  1  and  the  ratio 

test  (Step  5)  indicates  that  an  in-pivot  should  be  performed.  In  case  (i) , 

* 

it  is  easy  to  see  that  T)a  *  1  and  the  tableau  is  nondegenerate.  In 
case  (ii) ,  the  tableau  must  be  nondegenerate  in  order  for  the  in-pivot 
to  happen.  Q.E.D. 
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5.  THE  EQUIVALENCE.  As  Von  Hahenbalken  algorithm  applies  only  to 

programs  with  compact  feasible  sets,  we  assume  throughout  the  rest  of 

this  paper,  that  the  feasible  set  X  of  the  program  (1)  is  bounded.  In 

what  follows,  we  restate  the  algorithm  as  described  in  (Ref.  1).  Let 

f(x)  -  c  x  +  Jx  Cx  denote  the  objective  function,  and  grad  denote  the  gradient. 

Step  0  (Initialization)  Solve  the  linear  program 

T 

minimize  x  grad  f(0)  subject  to  x  Gx  . 

If  this  program  is  infeasible,  stop;  so  is  the  quadratic  program  (1). 

Otherwise,  let  x1  be  an  extreme  point  of  X.  For  t  *  0,  set 

t+1  -  1  ,  _t+l  r  M 

x  ■  x  and  B  *  (  x  }  . 


Step  1  (Major  Cycle)  Set  xC  ■  xt+1 ,  BC  *  Bt+1  and  let  SC  and  MC  be  the 

simplex  and  the  affine  manifold  generated  by  BC.  Use  linear  programming 

*  k 

to  locate  the  extreme  point  x  that  solves 


T  t 

minimize  x  grad  f(x  )  subject  to  x€X  (17) 

Step  2  (Termination  Test  )  Is  (x ^  -  xC)T  grad  f(xC)  equal  to  zero? 

If  yes,  stop;  the  vector  xC  is  an  optimal  solution  to  the  quadratic 

t  a  k 

program  (1).  Otherwise  augment  the  basis  B  by  x  to  form  the  new 
affine  basis  B  •  {x',...,x*t  '  ,x  ^  ]  . 


Step  3  (Minor  Cycle)  Attempt  to  find  a  minimizer  of  f  on  the  manifold  M 
generated  by  B.  If  f  possesses  a  minimizer  x  on  M,  go  to  Step  6. 
Otherwise,  find  its  minimizer  on  M/  where  M7  is  the  manifold  through  x^ 
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and  parallel  to  H  H  MC.  The  barycentric  representation  of  x  with 
respect  to  the  basis  B  is  x'  »  Bw'  with  w^  >  0  and  at  least  one  w^fc  <  0. 

Go  to  Step  7. 


Step  6  (In-Pivot)  The  barycentric  representation  of  the  minimizer  x 
is  x  -  Bw  with  w^  >0.  If  wj,  >  0  for  all  i,  set  xt+1  -  x,  Bt+1  =  B 
and  go  to  Step  1.  Otherwise  continue. 


Step  7.  Intersect  the  line  segment  xCx'  or  the  segment  xC x  with  the 
boundary  of  S,  the  simplex  generated  by  B;  the  intersection  point 


xf  «  Bwr  will  have  w£  >  0  for  all  i  with  w,r  >  0  and  at  least 


k  '  "  ’  one  Wi^c 

Set  Br  ■  B  \  {  s  }  and  let  Sr  be 


Let  s  be  an  index  such  that  w_ 


s 


the  simplex  generated  by  Br. 


Step  8  (Exchange -Pivot)  If  Sr  is  zero-dimensional,  set  xt+1  =  xr, 
t+1  IT 

B  ■  B  and  to  to  Step  1.  Otherwise  continue. 


Step  9  (Out-Pivot)  Set  xC  =  xr  ,  B  *  Br  ,  M  ■  Mr,  S  »  Sr  and  go  to 
step  3. 


Theorem  4.1.  The  Van  de  Panne -Whins ton  algorithm  stated  in  Section  3 
and  Von  Hohenbalken  algorithm  stated  above  generate  the  same  sequence 
of  primal  feasible  vectors  in  the  quadratic  program  (1). 

Proof.  To  prove  the  theorem,  we  consider  both  algorithms  entering  a  major 

cycle.  By  induction  on  the  number  of  major  cycles,  we  may  assume  that  the 

affine  basis  BC  (in  Von  Hohenbalken  algorithm)  is  the  same  as  P  (in 

*1 

Van  de  Panne -Whins ton  algorithm).  The  vector  xC  is  given  by 
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£  ★  'tc  ic 

x  ■  p  71  ■  x  with  x  being  the  feasible  vector  corresponding  to  the 

“l  *1 

index  set  or^ .  Under  this  identification,  it  is  inmediately  clear  that 

the  linear  program  (17)  is  precisely  the  one  (13).  The  termination  test 

(Step  2)  in  Von  Hohenbalken  algorithm  is  to  check  if  the  vector  xC  is  an 

optimal  solution  to  the  linear  program  (17).  By  using  the  equation  (11) 

★ 

to  obtain  the  following  explicit  expression  for  p 


-  (x  )T  (c  +  Cx  ) 


it  is  easy  to  see  that  the  corresponding  step  in  Van  de  Panne -Whins ton 
algorithm  is  doing  precisely  the  same  thing. 

After  Step  2,  the  two  algorithms  start  to  operate  somewhat  differently. 
To  establish  the  theorem,  it  suffices  to  show  that  at  the  completion  of  the 
major  cycle,  both  algorithms  generate  the  same  affine  basis  and  feasible 
vector.  To  achieve  this,  we  use  the  next  two  lemmas. 


Lemma  4.2.  Suppose  that  both  algorithms  enter  the  minor  cycle  with  the 
same  basis  and  extreme  point  from  Step  2.  Then  an  in-pivot  occurs  in  one 
algorithm  if  and  only  if  it  occurs  in  the  other.  Moreover,  the  feasible 
vectors  obtained  after  such  a  pivot  step  are  the  same. 

Proof.  Let  B  *  B  (J  fx  }  be  the  affine  basis  in  Von  Hohenbalken  algorithm 

with  Br  ■  P  being  the  corresponding  basis  in  Van  de  Panne -Whins ton  algorithm, 
"l 

Notice  that  x  * 

An  in-pivot  occurs  in  the  former  algorithm  if  and  only  if  f  has  a 
minimizer  x  ■  Bw  on  the  affine  manifold  M  generated  by  B  and  w  >  0. 

This  occurs  if  and  only  if  the  system 
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(V(t}>  <C  +  +  ^Uft}  “  0 


(eaiU{t})T \u{t)  "  1 


has  a  solution  (w  ..  ,  9)  with  w  ..  -  «  >  0  .  Since  the  matrix 

a^ll  1 1 }  Ofj^U  {tj 


B(a.)  -  /(P  )  CP  e 

1  /  al  “1  al 


is  nonsingular,  we  may  write  the  latter  system  as 


+  /  f 


“1  C 


(18a) 


0  -  L(x*)  +  p*  +  Gtt  Wt 


(18b) 


where 


/ \  /  ^  \ 

^  alJ  and  ^  “l  J  are  given  in  (11)  and  (14)  respectively  and 


Gtt  in  (16a).  (Recall  that  the  matrix  Q  is  vacuous.)  Observe  that 

the  system  (18)  is  precisely  the  relevant  portion  in  the  standard  tableau 

■  ic 

with  respect  to  the  basic  index  set  (cf.  (4)).  Since  L(x*)  +  p 

is  negative  (the  algorithm  is  not  terminated  yet)  it  is  obvious  that  the 
system  (18)  has  a  solution  with  w^  ^  ^  positive  if  and  only  if 
9  <  9  in  the  ratio  test  (Step  5  of  Van  de  Panne-Whins ton  algorithm)  or 
equivalently,  an  in-pivot  occurs  in  the  latter  algorithm.  Moreover,  if 
such  a  pivot  is  in  fact  performed,  it  follows  that  both  algorithms 

generate  the  same  feasible  vector  given  by  P  ..  f w  where 

C^Ult]  C^Uft} 


wa  U  {t}  18  the  uni<lue  (positive)  solution  to  (18).  This  proves  the  lensna. 


P§ 
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Lfipgflfl  4.3.  Suppose  that  the  affine  basis  Br  ■  P  contains  more  than  one 

al 

vector.  Then  the  same  conclusion  in  Lemma  4.2  holds  for  an  out-pivot. 

Proof.  By  Lenma  4.2  and  the  fact  that  an  exchange-pivot  (in  both  algorithms) 
is  performed  if  and  only  if  an  in-pivot  is  not  performed  and  the  current 

j* 

affine  basis  B  (i.e.,  P  )  is  a  singleton,  it  suffices  to  verify  that 

“l 

the  feasible  vectors  obtained  after  an  out-pivot  is  performed  are  the 
same.  To  prove  this,  observe  that  if  f  does  not  have  a  minimizer  x 
on  the  manifold  M  generated  by  B  -  BrU {xk]  ,  then  Step  3  of  the 
Von  Hohenbalken  algorithm  attempts  to  find  a  minimizer  x'  of  f  on  the 
manifold  M'.  It  is  easy  to  see  that  the  vector  x'  so  obtained  is  given 
by  p  w'  +  p  where  w'  is  the  solution  to  (18a)  with  w  -  1. 

Consequently,  in  either  case,  the  vector  xr  obtained  in  Step  7  of 
Von  Hohenbalken  algorithm  is  given  by 


xr  -  0*P  w  +  (1  -  9*)  P  T|*  +  6*  p  w„  for 


“l  al 


al  «1 


some  0  <  0*  <  1 


The  required  0*  is  chosen  to  be  the  largest  value  of  9  for  which  wr 

+  (1  -  9)  T]*  >  0  .  It  is  obviously  equal  to 
“l  ®1 


9*  -  min  f  -  11*  /  (Wi  -  I]*  )  ;  i  6  ^  <  J[*  }  . 

From  (18a)  it  follows  that  9*  w^  •  9  where  9^  is  the  minimum  ratio 
obtained  in  the  ratio  test  (Step  5)  of  Van  de  Panne-Whinston  algorithm. 
Thus,  the  vector  xr  is  equal  to 


*r  "  p<y  +  *  91 1  +  Pt  e1 

*1  ®1  “l  1 


which  is  precisely  the  one  generated  by  Van  de  Panne-Whinston  algorithm. 


This  proves  the  lemma. 


Q.E.D. 
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Combining  these  two  lemmas,  we  obtain  the  desired  conclusion  in 
Theorem  4.1  readily.  Finally,  we  point  out  that  the  two  algorithms  differ 
only  in  the  way  each  minor  cycle  is  carried  out.  Basically,  they  are 
the  same  algorithm. 

6.  APPENDIX.  The  example  below  (due  to  Professor  A.  Djang  of  the  Univer¬ 
sity  of  Kansas)  shows  that  the  Van  de  Panne-Whinston  algorithm  applied 
to  the  standard  formulation  (1)  of  a  quadratic  program  may  not  produce  the 
same  sequence  of  primal  feasible  vectors  as  Von  Hohenbalken  algorithm. 

Example .  Consider  the  program 

2  2 

minimize  ^/2(x^  +  X£>  -  x^  -  2x2 

subject  to  2x^  +  3x2  -  >  xi  +  ^x2  -  5  »  xi  >  x2  >  0  . 

Starting  at  the  origin,  the  Van  de  Panne-Whinston  algorithm  generates 
the  sequence:  (0,0),  (0,^)  and  (19/l5.  14/l5).  Starting  at  the  same 
point  the  Von  Hohenbalken  algorithm  generates  the  sequence:  (0,0), 

#>  ,  ff>  «nd  ('7,5  ,  ’Vl5)  . 
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